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ABSTRACT 



The invention provides a method and system by which 
research data can be collected and analyzed during the 
course of the research testing, and the research testing itself 
possibly modified to account for conclusions drawn from the 
research data. In a first aspect of the invention, a research 
subject can respond to a protocol stored on a server by 
manipulating input keys on a remotely located client device 
onto which a research protocol has been installed. The 
protocol can include questions concerning the subject's 
physical or mental well being such as whether their symp- 
toms are relieved or not, or even exacerbated. The protocol 
can also include calling for data obtained by coupling the 
client device with another medical device such as a glucose 
monitor. In a preferred embodiment, the subject is presented 
with narrowly structured questions and suggested answers 
provided by the protocol. The set of possible answers is 
restricted. In the event that a suggested answer is 
ambiguous, inapplicable or raises new questions, a protocol 
can present a new question to the subject. This elimination 
of fuzzy answers imposes a logical structure upon the 
subjects' assessments. In a second aspect of the invention, 
data entered by the subject is relayed using a communication 
link to a server device. This incoming data can be aggregated 
with other incoming data from subjects and their associated 
client devices. 

10 Claims, 3 Drawing Sheets 
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RESEARCH DATA COLLECTION AND 
ANALYSIS 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to research data collection and 
analysis. 

2. Related Art 

Human beings are sometimes used as subjects in different 10 
types of medical, psychological, and other research. 
Generally, such research fits into one of several broad 
categories: academic or industrial research, FDA clinical 
trials, and marketing and sales research. Human beings are 
also used as research subjects in experiments designed to 15 
correlate genotype and phenotype with drug reactions. For 
example, a researcher may seek to learn whether patients 
with the genotype for sickle cell disorder experience greater 
light sensitivity when taking a specific antibiotic. 

Academic and industrial investigators often employ 20 
human subjects to leam how humans respond to some 
pre -determined stimuli such as a drug or a psychological 
event. For a first example, an academic researcher may use 
post-menopausal women as subjects in experiments 
designed to widen our understanding of the neuroendocrine 25 
response to ethanol. Many different types of data can be 
obtained in such experiments. In this first example, a 
researcher could correlate the data on different hormone 
levels with blood alcohol levels, the frequency of selected 
patient behaviors, number of cigarettes smoked and many 30 
other possible factors. These data can be aggregated with 
similar data from other researchers and conclusions can be 
drawn based upon their observations. 

A second area in which human subjects are sometimes 35 
used as a research tool involves government approval of new 
drugs for human patients. The Food and Drug Administra- 
tion (FDA) approves new drugs that are to be marketed for 
human consumption. Presently, FDA approval is contingent 
upon the drug successfully passing three phases of testing 4Q 
during which the drug is blindly administered to human 
subjects. Taken together, these three phases of testing are 
called clinical trials. Only those drugs that successfully 
complete all three phases of clinical trials can be marketed. 

In the general course of events, the sponsor of a drug will 45 
submit an application and protocol to the FDA for clinical 
testing. After the application is reviewed and approved, 
Phase I of clinical testing begins. Experienced clinical 
investigators administer the drug to a small number of 
healthy volunteers. Although drug dosage and metabolism 50 
may be studied, the main focus of this initial testing phase 
is drug safety. Since safety concerns are paramount, testing 
is performed on a relatively small population (between 20 to 
100 subjects) for a short period of time. Drugs that induce 
toxic reactions or other adverse effects do not advance to 5S 
Phase II. This initial screening eliminates approximately 
30% of all applicants. 

The main focus of Phase II testing is to determine whether 
the drug is an effective treatment. Since the focus is on the 
effectiveness of the drug and the threat of adverse reactions 60 
has been largely ruled out, Phase II clinical trials involve a 
larger number of subjects (up to several hundred) who suffer 
from a problem the drug is designed to treat. Phase II trials 
may involve the blind testing of up to several hundred 
subjects. Only 33% of all drugs advance to phase III testing. 55 

Phase III testing may involve up to several thousand 
subjects. This phase lasts longer (between one to four years) 
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than either Phase I or Phase IL Here, the safety, dosage and 
effectiveness of the new drug are all rigorously screened. 
Between 25-30% of all drugs pass phase III trials and 
receive the required approval necessary for marketing. 

An additional level of testing is also employed. After a 
new drug has passed all three phases of clinical trials, 
researchers may also want to learn if any adverse effects 
occur after the drug is marketed. Thus, additional investi- 
gation may involve post-marketing surveillance of patients 
who have been administered the drug after it is approved by 
the FDA. Such post marketing surveillance is a useful tool 
that helps researchers learn more about how patients respond 
to a specific drug. 

Known marketing and sales research includes attempting 
to elicit responses from human participants regarding 
whether those participants would be more or less likely to 
purchase selected goods or services. It is known to attempt 
to correlate responses with demographic data about the 
participants (such as age, gender, household income, or 
residence locale), as well as psychological and other infor- 
mation about participants (such as whether participants are 
considered "early adopters"). 

Known methods for collecting and analyzing data from 
human subjects in research suffer from several drawbacks. 
While these methods generally achieve their respective 
goals of learning more about the human response to various 
stimuli, screening out ineffective and unnecessarily toxic 
drugs, and providing useful information for marketing or 
sales, known methods suffer from several drawbacks and 
limitations that can make them time-consuming or ineffi- 
cient. 

A first problem in the known art is that collection of data 
from subjects or participants in research or clinical trials 
often involves obtaining and analyzing fuzzy assessments 
from subjects who are not necessarily under the continual 
observation of a clinician or other personnel. Indeed, many 
subjects (such as the controls in clinical trials) are not under 
the care of a physician at all, but merely report to an expert 
researcher periodically for testing and analysis. Such testing 
and analysis frequently involves self-reporting a number of 
parameters. A subject's answer to an inquiry often involves 
the making of a fuzzy assessment of physical state, mood or 
quality of life. Accordingly, there is a need for a method to 
evaluate and standardize such fuzzy self-assessments. 

A second problem in the known art is that researchers are 
unable to respond to incoming data in real time. In known 
methods, data from research or clinical trials is collected and 
stored for analysis at a later time. Frequently, researchers or 
lab technicians enter their observations in a paper copy of a 
log book or lab notebook. Often these results are entered 
near the end of an experiment. This practice makes it 
impossible for an investigator to evaluate the data or change 
the experimental design. While researchers may have an 
approximate idea as to the general trend of incoming data, 
they are frequently unable to respond to that trend until the 
data is analyzed, well after any opportunity for altering the 
method of collection or the nature of the data collected. 
Accordingly, researchers are unable to modify a clinical 
protocol while in process. This inability to evaluate and 
respond to incoming data during data collection can create 
conditions that are dangerous for the subjects of the 
research. It is believed that morbidity and mortality associ- 
ated with evaluation of new drugs would be substantially 
reduced if researchers could respond during the research, 
such as to halt the clinical trial or adjust the drug dosage. 
Accordingly, there is a need to evaluate and respond to 
subjects in real time. 
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A third problem in the known art is that collection of data 
from research and clinical trials often calls for the aggrega- 
tion of data from many different geographical testing sites. 
It is believed that drug testing and other research would be 
quicker if there were a way to aggregate data and respond to 5 
it in real time, during the time of the trials or research. 
Accordingly, there is a need to aggregate and analyze data 
from many remote sites. 

A fourth problem in the known art is that identification of 
subjects in clinical trials who respond to a drug is not always 1Q 
readily apparent because it frequently requires evaluation of 
many different parameters. Part of this problem involves the 
nature of disease. In some cases, an acute condition will 
spontaneously heal, regardless of treatment. Chronic dis- 
eases often follow an unpredictable course as symptoms 
abate for a time and then worsen. Under these conditions, it 15 
is often difficult to determine whether the change in the 
subject's condition may be attributed to the drug or some 
other factor. Identifying subjects who respond to a drug is 
particularly problematic in Phase II trials where the issue is 
the efficacy of the drug. Accordingly, there is a need to be 20 
able to distinguish responders from non-responders on the 
basis of many different factors. 

A fifth problem in the known art involves the nature of 
research with human subjects. Most experiments involving 
administration of drugs are either blinded or double blinded. 25 
In blinded studies, the subject does not know whether they 
are receiving the active drug or a placebo. In essence, 
although the investigator knows what the subject is 
receiving, the subject does not know whether or not they are 
being used as a control. In double-blinded subjects, neither 30 
the researcher nor the research subject is aware of the 
subject's status. Blinded studies are problematic because 
researcher may impose his own bias on the incoming data. 
Double-blinded studies are problematic because the 
researcher may not be sensitive to phenomena that the 35 
subject is experiencing. Another problem raised in double - 
blinded studies is that the investigator very often becomes 
unblinded when observing the effect of a drug on a research 
subject. According, there is a need for an impartial, unbiased 
observer that remains responsive to the research subjects. 40 

Accordingly, it would be advantageous to provide a 
technique by which research data can be collected and 
analyzed during the course of the research testing, and the 
research testing itself possibly modified to account for 
conclusions drawn from the research data. For example, it 45 
would be advantageous to provide a device that can be 
carried by a research subject or participant that can be 
coupled and uncoupled to a communication system that is 
also accessible to researchers and other remote experts. Such 
a device would allow researchers to (1) collect, analyze and 50 
respond to input from the research subjects or participants in 
real time, (2) evaluate fuzzy assessments made by a subject 
or participant by making progressively narrower inquiries 
designed to obtain specific data, (3) aggregate and analyze 
data from a large number of remote sites quickly, (4) change 55 
the research protocol in response to input from subjects in 
real time and (5) rapidly identify responders and non- 
responders by correlating the data with a number of dispar- 
ate parameters that are not necessarily apparent when the 
study begins. These advantages are achieved in embodi- 60 
ments of the invention in which a research subject enters 
data using a client device that is coupled to a server via a 
communication link. 

SUMMARY OF THE INVENTION 65 

The invention provides a method and system by which 
research data can be collected and analyzed during the 
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course of the research testing, and the research testing itself 
possibly modified to account for conclusions drawn from the 
research data. In a first aspect of the invention, a research 
subject can respond to a protocol stored on a server by 
manipulating input keys on a remotely located client device 
onto which a research protocol has been installed. The 
protocol can include questions concerning the subject's 
physical or mental well being such as whether their symp- 
toms are relieved or not, or even exacerbated. The protocol 
can also include calling for data obtained by coupling the 
client device with another medical device such as a glucose 
monitor. In a preferred embodiment, the subject is presented 
with narrowly structured questions and suggested answers 
provided by the protocol. The set of possible answers is 
restricted. In the event that a suggested answer is 
ambiguous, inapplicable or raises new questions, a protocol 
can present a new question to the subject. This elimination 
of fuzzy answers imposes a logical structure upon the 
subjects* assessments. 

In a second aspect of the invention, data entered by the 
subject is relayed using a communication link to a server 
device. This incoming data can be aggregated with other 
incoming data from subjects and their associated client 
devices. In a preferred embodiment, the data is statistically 
analyzed according to parameters set by the protocol. 

In a third aspect of the invention, a remote expert research 
clinician can review incoming data from either the aggre- 
gated population or from individuals as it is being analyzed. 
Such rapid collection and analysis allows a researcher to 
change the protocol in response to the trend of the data, 
correlate different parameters of the data so as to better 
identify subjects that are responding to treatment and sched- 
ule appropriate interventions as needed. The researcher can 
also identify specific subgroups among the population of 
subjects, initiate new lines of inquiry and test new sub- 
hypotheses that may be raised by the incoming data. This 
includes correlating different drug responses experienced by 
phenotypically similar subjects with gene expression, and 
other variables. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

In the following descriptions, a preferred embodiment of 
the invention is described with regard to preferred process 
steps and data structures. Embodiments of the invention can 
be implemented using general-purpose processors or special 
purpose processors operating under program control, or 
other circuits, adapted to particular process steps and data 
structures described herein. Implementation of the process 
steps and data structures described herein would not require 
undue experimentation or further invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows a block diagram of a system 100 to collect 
and analyze data from human research subjects. 

FIGS. (2 A & 2B) shows a process flow diagram of a 
method for operating a system for interaction with a com- 
munity of individuals, including research subjects and inves- 
tigators. 

SYSTEM ELEMENTS 

FIG. 1 shows a block diagram of a system 100 to collect 
and analyze data from human subjects engaged in medical 
research using a protocol or other intelligent message, which 
acts in place of a researcher, investigator, clinician or other 
medical expert. 
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A system 100 includes a set of subject devices 110, a set At a step 202, a medical research expert 121 enters 

of medical research expert devices 120 and a server device information concerning the type of data to be collected from 

130. The subject device 110, the medical research expert a set of subjects 111 and a protocol 131 on a medical 

device 120 and the service device 130 are coupled using a research expert device 120. 

communication network 140. 5 At a step 203, the research information and protocol 131 

The set of research subject devices 110 is used by a set of entered onto the medical research expert device 120 is sent 

research subjects 111. Each research subject device includes to a server device 130 using the communication network 

an output element 112, an input element 113 and a port 114. 140. 

The subject 111 manipulates the subject device 110 to send At a step 204, the server device 130 records the research 

feedback from the subject 111 to the server 130 and to ™ information and protocol 131 submitted by the medical 

receive information from the protocol 131. Port 114 can be research expert 121 in the database 132. 

coupled to a variety of medical appliances to send additional A t a step 205 in a preferred embodiment, the server device 

data to the server 130. 130 lhe research information and protocol 131 to a set 

The set of medical research expert devices 120 is used by of research subject devices 110 using the communication 

a set of medical research experts 121. Each medical expert 15 network 140. In alternative embodiments, the server device 

device includes an output element 122 and an input element 130 may send the research and protocol 131 information to 

123, other medical research experts 121 for review. 

The server device 130 includes a protocol 131 and a At a step 206 the set of research subjects 111 view some 

database 132. 20 portion of the protocol 131 that was sent to the set of 

For further information regarding a data structure and research subject devices 110 by looking at a presentation 

simplified research subject interface, and preferred embodi- screen or other output element 112 contained in the research 

ments of the subject device 110, medical research expert subject device 110. 

device 120 and the server device 130 including data base At a step 207, the set of subjects 111 respond to the 

132, see related application Ser. No. 09/201,323, Express 2 s protocol 131 sent to the set of research subject devices 110 

Mailing No. EE143637591US, filed Nov. 30, 1998 in the by manipulating a keypad or other input 113 included in the 

name of Stephen J. Brown, titled "Leveraging Interaction research subject device 110. Alternatively, the set of subjects 

with a Community of Individuals," assigned to the same 111 respond to the protocol 131 sent to them by coupling the 

assignee, attorney docket number HHN-007, and other subject device 110, using a port 114 included in the research 

related applications incorporated by reference therein. 30 subject device 110, to a medical appliance such as one or 

For further information regarding the protocol or other more °U or some combination of, the following: a blood 

intelligent message used by the system, see related applica- glucose meter, an oxymeter, a peak flow meter, a blood 

tion Ser. No. 09/203,882, Express Mailing No. pressure gauge, a weight scale, a pulse sensor, a home 

EE143637565US, filed Dec, 1, 1998, in the name of infusion system, a CPAP sleep apnea device, a location 

Stephen, J. Brown, titled "Remote User Data Collection 35 sensing device, a digital video camera or a drug dispensing 

Protocols Including Data Structures and User Interface," apparatus. 

assigned to the same assignee, attorney docket number At a step 208, the research subject 111 has completed 

HHN-002 and other related applications incorporated by responding to the protocol 131. 

references therein. At a step 209, the subject device 110 is coupled to a 

For information regarding a medicine dispenser which 40 communication network 140 which sends the information 

can be used by the system, see related application Ser. No. entered by the subject 111 in response to the protocol 131 to 

09/203,880, Express Mail Mailing No. EE143637557US, the server device 130. 

filed Dec. 1, 1998, in the name of Stephen J. Brown, et al, At a step 210 the information received by the server 

titled "Using a Computer Communication System with device 130 is recorded in the database 132. 

Feedback to Dispense Medicine," assigned to the same <5 A( a step 2n> the information rece ived from the research 

assignee, attorney docket number HHN-005, and other subject devices 110 is aggregated and statistically analyzed, 

related applications incorporated by reference therein. At a step 2U [q a preferred embo diment, the server 

For information regarding genotype and phenotype device 130 sends the information received from the research 

correlation, see related U.S. Pat. No. 5,985,559, Express subject devices 110 to the various medical research experts 

Mail Mailing No. EI113824573US, filed May 3, 1998 in the 50 121. In an alternative embodiment, the server device 130 

nameof Stephen J. Brown, et al. titled "System and Method does not send the information. The information remains 

for Preventing, Diagnosing and Treating Genetic and available on the server device 130 where it can be looked up 

Pathogen-Caused Disease", assigned to the same assignee, by interested parties. 

attorney docket number RYA-128 and application Ser. No. A t a step 213, the information received by the server 

09/041,809, Express Mail Mailing No. EE262620680US, device 130 from the rescarch subjecl device 

110 is evaluated 

filed March 13, 1998 in the name of Stephen J Brown, et al. the protocol 131 

titled "Phenoscope and Phenobase", assigned to the same A . , t , ( , j4 4 , « 

assignee attornev docket number RYA 136 At a Step 214 ' the pr0tOCo1 131 updates ^ research 

assignee, attorney docket number KYA 136. information and either leaves it unchanged or modifies it in 

Method of Operation 60 accordance with the protocol logic. 

„ , ,„ „ „ At a step 215, in a preferred embodiment, the server 

FIG. 2 shows a process flow diagram of a method for device m sends the dated research information and 

collecting data from human research subjects to be per- protocol 131 10 the set of research expert devices m usill g 

formed by the system and for analyzing and reporting that the communication network 140. In an alternative 

data to rescarch experts. 65 embodiment, the server device 130 does not send the 

A method 200 is performed by a system 100, as follows: updated research information to the medical research expert 

At a flow point 201, the system 100 is ready to proceed. device 120. 
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At a step 216, the medical research expert 121 review the 
updated information and protocol 131 and the other infor- 
mation input by the set of research subjects 111 and either 
leave the updated research information and protocol 
unchanged or modify it as necessary. In an alternative 
embodiment, step 216 does not take place. 

At a step 217, in a preferred embodiment, the research 
information and protocol 131 as unchanged or modified by 
the medical research expert(s) 121 is sent to the server 
device 130 using the communications network 140. In an 
alternative embodiment, step 217 does not take place. 

At a step 218, the server device 130 records the modified 
research and protocol 131 information sent by the medical 
research expert 121 in the database 132. In an alternative 
embodiment, step 218 does not take place. 

At a step 219 in a preferred embodiment, the server device 
130 sends the research and protocol 131 information as 
unchanged or as modified by the medical research expert 
121 to the research subject device 110 using the communi- 
cation network 130. In an alternative embodiment, step 219 
does not take place. 

At a step 220, the research subject 111 views the 
unchanged or modified protocol, as they did in step 206. 

At a step 221, the method repeats steps 207 through 216 
until all desired information is obtained from the subject and 
the protocol 131 has been completed. After sending the 
information to the medical research expert(s) for final 
review (step 216), the information resides in the database 
and the method is complete. 

At a step 222, the method has completely performed a 
system 100. 

Alternative Embodiments 

Although preferred embodiments are disclosed herein, 
many variations are possible which remain within the 
concept, scope and spirit of the invention, and these varia- 
tions would become clear to those skilled in the art after 
perusal of this application. 

What is claimed is: 

1. An automated computer implemented dynamic medical 
research testing method comprising: 

a. collecting medical data from a plurality of medical 
research subjects, using a medical research testing 
protocol for collecting data, wherein said medical 
research testing protocol includes receiving data from 
said subjects using an input devices according to a 
medical research testing goal; 

b. sending the medical data collected from said input 
devices to a server device over a communications 
network, wherein said server is located relatively 
remote from said input device; 

c. automatically aggregating the sent medical data; 

d. automatically performing statistical analysis of the 
aggregated medical data; 

c. automatically generating an updated medical research 
testing protocol according to the statistically analyzed 
data and a predefined medical research testing protocol 
logic; 

f. sending the statistically analyzed data to a medical 
research expert device associated with a medical 
research expert; 

g. presenting the statistically analyzed data at the medical 
research expert device for viewing by a medical 
research expert, wherein said medical research expert 
device is relatively remote from said input device; and 



h. repeating a-g using the generated updated medical 
research testing protocol until at least one of the 
medical research expert or the medical research testing 
protocol logic determines the medical research testing 

5 is complete. 

2. The method of claim 1, further comprising: 

i. sending the updated medical research testing protocol to 
the medical research expert device; 

j. editing the updated medical research testing protocol at 
10 the medical research expert device according to the 
presented statistically analyzed data; and 
k. repeating a-g, i and j using the edited medical research 
testing protocol until at least one of the medical 
research expert or the medical research testing protocol 
logic determines the medical research testing is com- 
plete. 

3. The method of claim 1, wherein the collected data 
comprises data generated by a medical device coupled to the 
input device. 

4. The method of claim 1, wherein prior to collecting data, 
generating the protocol at a medical research expert device 
coupled to the communications network and sending the 
generated protocol to the input device over the communi- 
cations network. 

5. The method of claim 1, wherein the generated and 
updated protocols present at least one question and receives 
the answers to the at least one question. 

6. An automated medical research testing system com- 
prising: 

a medical research subject system comprising: 

an input device for collecting medical data from medi- 
cal research subjects according to a medical research 
testing protocol, wherein said medical research test- 
ing protocol includes a component for receiving 
medical data from said subjects according to a medi- 
cal research testing goal; and 
a communication component for sending the collected 
data over a communications network; 
a server comprising: 

a first component for receiving the sent data over the 

communications network; 
a processor for aggregating the received medical data, 
for automatically performing statistical analysis of 
45 the aggregated medical data and for automatically 

generating an updated medical research testing pro- 
tocol according to the statistically analyzed data and 
a predefined medical research testing protocol logic; 
and 

a second component for sending the formatted data 
over the communications network; and 
a medical research expert device associated with a medi- 
cal research expert comprising: 
a first component for receiving the statistically ana- 
55 lyzed data sent over the communications network; 

and 

a presentation device for presenting the received sta- 
tistically analyzed data to the medical research 
expert; 

60 wherein the medical research subject system and the 
server repeat their respective functions using the gen- 
erated updated medical research testing protocol until 
at least one of the medical research expert or the 
medical research testing protocol logic determines the 

65 medical research testing is complete. 

7. The system of claim 6, wherein the server sends the 
updated protocol to the medical research expert device; the 
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medical research expert device further comprises an editing 
component for editing the updated medical research testing 
protocol according to the presented statistically anal data. 

8. The system of claim 6, wherein the collected data 
comprises data generated by a medical device coupled to the 
input device. 

9. The system of claim 6, wherein the medical research 
expert device comprises a second component for generating 
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the medical research testing protocol and sending the gen- 
erated protocol to the input device over the communications 
network. 

10. The system of claim 6, wherein the generated and 
updated medical research testing protocols present at least 
one question and receives the answers to the at least one 
question. 
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